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Systems evolving according to the standard concept of biological or technological evolution are 
often described by catalytic evolution equations. We study the structure of these equations and find 
a deep relationship to classical thermodynamics. In particular we can demonstrate the existence 
of several distinct phases of evolutionary dynamics: a phase of fast growing diversity, one of sta- 
tionary, finite diversity, and one of rapidly decaying diversity. While the first two phases have been 
subject to previous work, here we focus on the destructive aspects - in particular the phase diagram 
- of evolutionary dynamics. We further propose a dynamical model of diversity which captures 
spontaneous creation and destruction processes fully respecting the phase diagrams of evolutionary 
systems. The emergent timeseries show a Zipf law in the diversity dynamics, which is e.g. observable 
in actual economical data, e.g. in firm bankruptcy data. We believe the present model is a way to 
cast the famous qualitative picture of Schumpeterian economic evolution, into a quantifiable and 
testable framework. 

PACS numbers: 87.10. +e, 02. 10. Ox, 05.70.Ln, 05.65.+b 



I. INTRODUCTION 

Simplistically technological evolution is a process of (re) combination and substitution of existing elements to invent 
and produce new goods, products or things. New things can come into existence through combining existing ones 
in whole or part. The new things then undergo a 'valuation' (selection) process based on their 'utility' associated to 
them in the context of their surroundings. The surroundings are defined by all other yet existing things, and all things 
which may come into existence in the foreseeable future. Another way how new things can come to being is pure 
chance, such as random inventions which do not rely on pre-existing things. Biological evolution is a special case of 
technological evolution (i.e. innovation), where recombination and substitution happens through sexual reproduction 
and mutations. 

The dynamics of systems capable of evolution have been formalized some time ago. In this context the concept of 
the adjacent possible has been brought forward pQ. The adjacent possible is the set of objects that can get produced 
within a given time span into the future. What can get produced in the next timestep depends crucially on the 
details of the set of elements that exist now. To capture the dynamics of an evolving system which is governed by 
a combination/substitution mechanism, imagine that the diversity of the system is given by a d dimensional state 
vector x. Each element Xj characterizes the abundance of all possible elements i. This means that the total number of 
all elements that can potentially ever exist in the system are bounded from above by d [12 . Its dynamics is governed 
by the famous equation 

l^X^ — OLijkXjXfc Xi ^ ^ Q-ljkXjXk , (1) 

where the second term ensures normalization of x. x thus captures the relative abundances of existing elements. The 
tensor elements ctijk serve as a 'rule table', telling which combination of two elements j and k can produce a third 
(new) clement i. The element a^t is the rate at which clement i can get produced, given the elements j and k are 
abundant at their respective concentrations Xj and x^. Equation (fib has a long tradition; some of its special cases are 
the Lotka Volterra replicators see e.g. in [2J, the hypercycle [3J, or the Turing gas [I]. Equation (|T|) has been analyzed 
numerically [5j[6], however system sizes are extremely limited. In contrast to the amount of available qualitative and 
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historical knowledge on evolution [7 , surprisingly little effort has been undertaken to solve Eq. ([I]) explicitly. To 
understand the dynamics of Eq. ([l]) more deeply and analytically it was suggested in [8] to assume three things: (i) 
the focus is shifted from the actual concentration of elements x<, to the system's diversity. Diversity is defined as the 
number of existing elements. An clement exists, if x% > 0, and does not exist if Xi = 0. (ii) For simplicity, the rule 
table a is assumed to have binary entries, and 1 only, (iii) the location of the non-zero entries is perfectly random. 
To characterize the number of these entries the number r is introduced, which is the rule table density or the density 
of productive pairs. The total number of productive pairs in the system (i.e. the number of non-zero entries in a) is 
consequently given by r d. 

With these assumptions, the idea in [5] was to explicitly formalize the concept of the adjacent possible, so that Eq. 
could be rewritten into a dynamical map whose asymptotic limit could be found analytically. The only variable 
of the corresponding map is r. The initial condition, i.e., the initial size of present elements is assigned a . The 
solution of the system is the asymptotical value (t — > oo) of diversity, Ooo. The amazing result of this solution, (as a 
function of r and the initial condition ao) is that evolutionary systems of the type of Eq. ([I]) have a phase transition 
in the r-a$ plane. In one of the two phases - after a few iterations - no more elements can be built up from existing 
ones and the total diversity converges to a finite number (sub-critical phase). The other phase is characterized that 
the advent of new elements creates so many more possibilities to create yet other elements that the system ends 
up producing all or almost all possible d elements This we call the super-critical or 'fully populated' phase. Even 
though the existence of a phase transition was hypothesized some time ago in [1 , it is entirely surprising that the 
phase transition is mathematically of exactly the same type as a Van der Waals gas [13] . Note that this model is a 
mathematically tractable variant of the so called bit-string model of biological evolution, introduced in pQ. 

The dynamics discussed so far assumes that a system is starting with relatively low diversity ao, which increases 
over time, up to a final asymptotic level, a^. However, also the opposite dynamics is possible. Imagine one existing 
element, say i, is removed from the system, a species is dying out, or a technical tool gets out of fashion/production. 
This removal can imply that other elements, which needed i as a production input will also cease to exist, unless some 
other way exists to produce them (not involving i). Note, that all the necessary information is incorporated in a. 

The first part of this paper studies the dynamics of evolutionary systems which exist in the highly populated phase, 
and where 5a elements get kicked out at the initial timestep. These defected elements may trigger others to default 
as well. We demonstrate the existence of a new phase transition in the So-r plane, meaning that for a fixed rule 
density r there exists a critical value of initial defects, above which the majority of elements will die out in a cascade 
of secondary defects. 

The understanding of these phase diagrams teaches something about the class of dynamical systems to which the 
mechanism of evolution belongs to. However, this is only part of the story: it does not yet constitute the (microscopic) 
dynamics of the system |14j . 

In reality, the final diversity will not be a constant, but will be subject to fluctuations. The relevant parameter 
will become the diversity (number of nonzero elements in x) over time, a*. In particular, there are two types of 
fluctuations: elements will get created spontaneously with a given rate, and existing elements will go extinct with 
another rate. The second part of this work proposes a dynamical model of an evolutionary system incorporating 
these spontaneous processes, compatible with their inherent phase diagrams. The model is characterized by the rule 
density r, one creation and one destruction process, the latter ones modeled by simple Poisson processes. We study 
the resulting dynamics and find several characteristics typical to critical systems and destructive economical dynamics 
described qualitatively by J. A. Schumpeter a long time ago [Si- 
ll. THE CREATIVE PHASE TRANSITION 

The dynamics of diversity (number of existing elements over time) has been analytically solved in [5]. To be self- 
consistent in this section we review the argument: It is first assumed that the system has a growing mode only (tensor 
elements are zero or one but never negative). For this situation Eq. ([I]) was projected onto a dynamical map, 
whose asymptotic solutions can be found. 

If the number of non-zero elements in x(t) is denoted by at, it was shown in [5] that the non-linear, second order 
recurrence equations associated with Eq. are given by 

flf+i =at + Aa t , Aa t+ i = ^ (l - ^±ij (a 2 t+1 - a\) , (2) 

with the initial conditions ao being the initial number of present elements and a_i = 0, by convention. The question 
is to find the final diversity of the system, a^. These equations are exactly solvable in the long-time limit. For this 
end define, c t = Aa t +i/ Aa t , and look at the asymptotic behavior, c = lim^oo c t . From Eq. ^ we get 



3 




FIG. 1: Phase diagram of the creative dynamics over the r-ao space. 



On the other hand we can estimate Oqo asymptotically by 



t=o 



Introducing Eq. (|3| into Eq. Q one gets a third order equation, whose solutions are the solution to the problem. 
Most remarkably these solutions are mathematically identical to the description of real gases, i.e. Van der Waals gases. 
As real gases our system shows a phase transition phenomenon. The corresponding phase diagram, as a function of 
the model parameter r and the initial condition ao is shown in Fig. [I] 

One can make the relation to the Van der Waals gas more explicit by defining, V = doo/d and r = ao/d. Using 
this in Eqs. ([3| and Q gives V — r = 2r(l — V)V 2 . Renaming variables 



leads to the famous equation, 



11 T 

P = 1 and T = (5) 

V 2rV 3 2rV 3 y ' 



P-±)V = T , ((.) 



V 2 



which is exactly a Van der Waals gas of point-particles with constant (negative) internal pressure. The meaning of 
'pressure' and 'temperature' in our context is intuitively clear. 



III. THE DESTRUCTIVE PHASE TRANSITION 



In the dynamics studied so far diversity can only increase due to the positivity of the elements in a. It is important 
to note that in this setting the phase transition can not be crossed in the backward direction. This is because of two 
reasons. First, the system forgets its initial condition ao once it has reached the (almost) fully populated state. This 
means that after everything has been produced one can not lower the initial set size any more. In terms of the Van 
der Waals gas equation analogy we can not lower the 'temperature' and we can not cross the phase transition in the 
backward direction. Second, if r is a homogeneous characteristic of the system then it is also impossible to manipulate 
the 'pressure' of the system and we remain in the fully populated phase for ever. 

The natural question thus arises what happens to the dynamics if one randomly kills a fraction of elements in the 
fully (or almost fully) populated phase. In the case that an element k gets produced by a single pair and one 
of these - either i or j - gets killed, k can not be produced any longer. We call the random removal of i a primary 
deject, the result - here the stop of production of k - is a secondary deject, denoted by SD. The question is whether 
there exist critical conditions of r and a primary defect density Sq, such that cascading defects will occur. 

As before we approach this question iteratively, by asking how many secondary defects will be caused by an initial 
set of Do randomly removed elements in the fully populated phase. We define the primary defect density So = Dg/d. 
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The possibility for a secondary defect happening to element k requires that all productive pairs, which can produce 
k, have to be destroyed, i.e. at least one element of the productive pair has to be eliminated [15]. This requires 
some 'book-keeping' of the number of elements that partially have lost some of their productive pairs due to defects. 
We introduce a book-keeping set G n of sequences g n i, G n — {g n o,9ni, 9n2,gn3, ■ • • }, where dg n i denotes the number 
of elements that have lost / ways to be produced (i.e. productive pairs), given that initially n elements have been 
eliminated. 

To be entirely clear, let us introduce the first defect. This defect will on average affect 2r productive pairs in the 
system, i.e., there will be 2r elements that loose one way of being produced |T5] . We naturally assume d 3> d5o 3> r > 1, 
and disregard the vanishingly small probability that one element looses two or more of its productive pairs by one 
primary defect. 

Before the first defect we have Go = {1,0,0,---}, meaning that there are d entities that have lost none of their 
producing pairs. The first defect will decrease this number d — > d — 2r, i.e., we get 2r elements that have lost one of 
their producing pairs. Consequently we find G\ = {1 — p,p, 0, 0, • • • }, where p is defined as p = 2r/d. Now, defecting 
the second clement will affect another 2r elements through their producing pairs. This time we affect an element that 
has lost none of its producing pairs with probability 1 — p, and with probability p we affect an element that already 
has lost one of its producing pairs. Iterating this idea of subsequent defects leads to the recurrence relations 

9n+\ o = 9n0 (1 - p) and g n+ i k = g n + (g n k-i ~ 9n k) P ■ (7) 

It is easy to show that g n k follows a binomial law, g n k — ( ^ J ?> fe (l ~ p) n ~ k ■ The number of secondary defects after 

n introduced defects, denoted by SD n , is just the number of all entities that have lost all of their (on average) r 
producing pairs and can be estimated by d ^2 k>r g n k- Defining 

SD n = Y,9nk , (8) 

k>r 

one finds the update equation for SD n by inserting ^ into ([8]), 

SD n+1 = SD n +pg nr _i . (9) 
Now, if d Sg and d Si are the numbers of primary and secondary defects respectively, one has to identify 

8! = SD d5o . (10) 

This is nothing but 

Since we assume d 3> dSo 3> r > 1, Stirling's approximation is reasonable, ln(n!) ~ nln(n) — n + | ln(27rn), so that the 



binomial coefficient is approximated by, 



( m ) ~ (^) m em ( 27rm ) _1/2 > where C 1 " m/n) n - m - exp(-m), for n > to. 



Further one can approximate (1 — p) n r+1 ~ exp(— np). Inserting these approximations into Eq. (Ill, and replacing 
the sum by an integral one gets 

n r fd S 

Si = -7=(r- lY^e 1 '- 1 / dxx r - 1 e- wp . (12) 



/2tt 

Since pdSo = 2r<5o, and by approximating pr ~ (for the lower limit) we rewrite the integral 

d S r2rS 

dxx r - x e- xv ~p-' r \ dyy^e-y , (13) 



o 



and we can finally compute 



with 



S 1 = 1 (r)f(r,6 )S r , (14) 



7(0 = ^(r-l^-V- 1 
fir, S ) = E: =0 ^(-Mo)' 



(15) 
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FIG. 2: Phase diagram for the defect dynamics for two ways of iterating Eq. ( 14 1 described in the text 



Here / is obtained by expanding the exponential in the integral of Eq. (13 
What remains to be done is to iterate Eq. (14 1. There are two possib 



) into a Taylor series, 
e ways of doing so. In the first iteration 
scheme we think of collecting the primary and secondary defects together and assume that we would start with a new 
primary defect set of size S' = So + Si- The tertiary defects therefore would be estimated by 5 2 = S[ — Si, where 5[ 
are the secondary defects associated with S' . This leads to the recursive scheme (A), 



k=l 



5„+i = 7(r)/(r,A n )A;-A n + 5 1 (A). 



(16) 



The second way to iterate Eq. ( 14 1 is to assume that we use the d8\ secondary defects as primary defects on the 



smaller (rcscalcd) system d(l — Sq) so that we look at a new primary defect-ratio S' = S\/{1 — Sq). The result S[ then 
has to be rescaled inversely to give the tertiary defects in the original scale, i.e. 5 2 = (1 — Sq)S' 1 . Iterating this idea 
leads to the recurrence relation (B), 



A„ = S k 

fe=l 



<5 n+1 = 7 (r)(l-A„_ 1 ) 1 - r / 



S n 



1 - A, 



5 T n (B), 



(17) 



with Ao = 0. 

The result in terms of a phase diagram of the two possible iteration schemes (A) and (B) is given in Fig. [2] (a) and 
(b), respectively. The asymptotic defect size S^ (for t — > oo) is shown as a function of the parameters r and the initial 
defect density As before a clear phase transition is visible, meaning that at a fixed value of r there exists a critical 
number of initial defects at which the system will experience a catastrophic decline of diversity. Unfortunately, an 
analytical solution for the asymptotic iterations of Eq. ( [14] ) seems to be beyond the capabilities of the authors. It is 
interesting that complete destruction of diversity (plateau in Fig. [2]) not very large values of Sq are necessary. 



IV. COMBINED DYNAMICS: CREATIVE GALES OF DECONSTRUCTION 



To become more realistic, since we have now established the existence of phase transitions in both the creative 
and destructive regimes, and are equipped with the update equations for the respective cases Eqs. ^ and (14 1, it is 
natural to couple these update equations and to study the combined dynamics. The relevant variable now becomes 
the diversity in the system as a function of time, at- However, the question how this should be done is neither trivial 
nor uniquely determined. 

One realistic scenario might be that at any point in time some goods/species/elements may come into being 
spontaneously and others go extinct at certain rates. First, for the introduction of new elements we introduce a 
stochastic rate, x + > of a Poisson process, so that (d — at)xt new species may be expected in one time unit. Note, 
that there are d — at 'un-populated' elements in the system. These randomly created elements are elements that 
did not get produced through (re) combination or substitution of existing ones, but are 'out of the blue' inventions. 
The natural time unit we are supplied with is one creative generation at — * at+i- The spontaneous creation may 
eventually increase the critical threshold and the system may transit into the highly diverse phase (think of this 
process to randomly alter ao in the creative update dynamics). 

On the other hand there are spontaneous processes that destroy or remove species at a stochastic rate, \~ > 
(Poisson process), such that about atXt new defects may be expected per time unit. It can not be assumed a priori 
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that the iterative accumulation of secondary defects in the system, as described above, operates at the same time 
scale as the spontaneous or the deterministic creative processes. 

For making an explicit choice we may assume that during one time unit there happen r\ t generations of secondary 
defects, taking into account the relative ratio of innovative and secondary defect generations processed per time unit. 
We assume that rj t can be modeled by a Poisson process whose rate, (rj t ) = rj becomes a parameter of the model. For 
the computations below we have chosen r\ — 0.1. 

When we look at the way secondary defects evolve in generations we are left with a culminated number of secondary 
defects A Vt t after rj t generations and a remainder 6^ t , which would have to be added to A„ t t in the next defect- 
generation, r\t + 1 but which - by assumption - is falling into the book-keeping of the next creative-generation time 
step t+1. What we say is that during time step t — *■ t + 1, there are A~~a t — dA nut species removed from the 
system, where A mt = J2T=o is the cumulated ratio of secondary defect ratios 8k t of defect-generation k at time 
step t. The remaining defects of generation % have to be accounted for in the next time step together with the newly 
introduced spontaneous defects, so that Sq t+i — ^rXt + $vt,t- The update of defect generations now can be performed 
rjt times according to 

<Wit = (1 - &mt)lrf{r,5 mt )~5 r mt , (18) 

where we have considered the rescaling approach (B) to secondary defect generations. A similar equation can be 
derived for scheme (A). For convenience of notation we write for the rescaled defect ratios, S mt = ^ a* • ^ now ; by 
coincidence, the remaining defects from the last time step and the spontaneously introduced defects are sufficiently 
many and there are enough defect-generations r\t processed in that time step, the culminating secondary defects may 
lead to a break down of the system from the high to the low diversity regime. 

All that is left is to insert this dynamics into the creative update equation. To do so we first note that without 
defects, Aat depends on both at and a, t -\. However, due to the occurring defects at-i will not remain what it was 
when t becomes updated to t + 1, but will be decreased by the occurring defects in this time span. For this reason 
it is convenient to introduce a new variable b t which takes the place of at-i in the coupled update process. More 
precisely, b t +i = a t — A~a t - For the growth condition to be well defined we require a t > b t , which is guaranteed by 
at+\ = b t+ i + A + at where 



A+a t ^ r -(l-°±) ( a ->-b*) + (d-a t )xt 



(19) 
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is the number of deterministically (by the creative update law) and spontaneously introduced species in the creative- 
generation t. This sort of coupling allows to take a look at how diversity of systems may evolve over time, driven by 
the spontaneous creation and destruction processes x ± i which may reflect exogenous influences, while on the other 
hand the average number of defect-generations 77 per creative generation t, and the average number of productive 
pairs per species r express endogenous properties of the system, i.e. whether the defects process slow or fast (77), and 
the average dependency (r) of the catalytic network. 

We study the resulting timeseries for this dynamics for several values of r, ao, r\, and x ± ■ I n Fig- HJ by fixing 
r = 5 and the Poisson rates 77, and \ ± an d by varying ao from 0.01 to 0.1, we cross the creative phase transition line 
from the sub-critical to the fully populated phase. At ao = 0.056 we observe a flip-flop transition between the two 
phases. The flip-flop transitions happen over very short time intervals. In Fig. [3] (b) the increment distribution of 
Aa t = a t — is shown. It is clearly seen that the distribution is power law whenever the super-critical phase is 
sufficiently populated. The Poissonian driving in the creative dynamics in the sub-critical region is clearly seen for 
ao = 0.002 in Fig. [3](d). By power-law fits to the exponents in the deconstructive regime, we observe a sign for an 
existence of a Zipf law, i.e. 7 ~ 1. 

V. CONCLUSION 

We have shown the existence of a new phase transition in systems capable of evolutionary dynamics. Given that 
the system is in its highly diverse state, the introduction of relatively little primary removal of elements can cause 
drastic declines in diversity. We have further proposed a dynamical model to study timeseries of diversity in systems 
governed by the evolution equation (JT|) under the influence of external spontaneous creation and destruction processes. 
We emphasize that we strictly stick to the structure of Eq. ([I]) and do not discuss variants, such as the beautiful 
work of [TD] . In contrast they have studied a linear version (resembling catalytic equations) , however with an explicit 
'selection' mechanism incorporated in a dynamic rule table. 

As the main result of this present work we re-discover what J. A. Schumpeter has heuristically and qualitatively 
described as creative gales of dcconstruction. More importantly we are able to quantify the dynamics of such systems. 
As an example destructive processes can be quantified in real world situations by bankruptcies of firms. In this context 
the existence of a power law and in particular empirical evidence for a Zipf law - similar to the one resulting from 
our model - has been found in 11]. As in the work of |10j we observe the importance of different time scales in the 
coupled dynamics. In our approach we have incorporated this aspect by noting that creation and destruction do not 
work necessarily on the same time scales. Let us mention as a final comment that the results do of course not only 
apply to technological evolution but to any biological, social, or physical system governed by the evolution equation, 
Eq. Q. 
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